Multi-depth-interval refocusing method and apparatus and electronic device

ABSTRACT

A multi-depth-interval refocusing method, apparatus and electronic device are provided. The method includes displaying an image on a display device; acquiring user input, and determining, in the displayed image according to the user input, a refocus area including at least two discontinuous depth intervals, where each depth interval in the at least two discontinuous depth intervals is constituted by at least one depth plane, each depth plane contains at least one focus pixel, and depths of object points corresponding to focus pixels contained on a same depth plane are the same; performing refocusing processing on an image within the refocus area to display a refocused image on the display device, where the refocused image has a visually distinguishable definition difference relative to an area, except the refocus area, in the displayed image; and displaying the refocused image on the display device. Therefore, multi-depth-interval refocusing is implemented.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of International Application No.PCT/CN2014/080053, filed on Jun. 17, 2014, which claims priority toChinese Patent Application No. 201310288099.5, filed on Jul. 10, 2013,both of which are hereby incorporated by reference in their entireties.

TECHNICAL FIELD

The present disclosure relates to technologies of human-computerinteraction and image processing, and in particular, to amulti-depth-interval refocusing method, apparatus and electronic device.

BACKGROUND

Refocusing refers to reselecting a focal plane or a depth-of-field of apicture according to a user need after the picture is formed. Whenwatching the picture, a viewer may select a scenery of interest to makethe scenery clear, without having to passively watch a themed sceneryselected by a photographer.

According to a refocusing method in the prior art, refocusing can beperformed only on a single depth plane. In this manner, only one areacorresponding to one depth plane can be selected at a time. However, inan actual application, a user may need to perform refocusing on multipledepth planes or one or more depth intervals, and the existing refocusingmethod cannot meet the user need. Even adding buttons or setting amulti-level menu cannot well resolve this problem, only to add memoryload of the user. Therefore, a multi-depth-interval refocusing methodurgently needs to be proposed.

SUMMARY

Embodiments of the present disclosure provide a multi-depth-intervalrefocusing method, apparatus and electronic device, which are used toimplement multi-depth-interval refocusing.

According to a first aspect, an embodiment of the present disclosureprovides a multi-depth-interval refocusing method, including displayingan image on a display device; acquiring user input, and determining, inthe displayed image according to the user input, a refocus areaincluding at least two discontinuous depth intervals, where each depthinterval in the at least two discontinuous depth intervals isconstituted by at least one depth plane, each depth plane contains atleast one focus pixel, and depths of object points corresponding tofocus pixels contained on a same depth plane are the same; performingrefocusing processing on an image within the refocus area to display arefocused image on the display device, where the refocused image has avisually distinguishable definition difference relative to an area,except the refocus area, in the displayed image; and displaying therefocused image on the display device.

In a first possible implementation manner of the first aspect, thedisplaying an image on a display device includes displaying, on thedisplay device, an image focused on any depth plane; or displaying, onthe display device, an image focused within any depth interval.

In a second possible implementation manner of the first aspect, theacquiring user input, and determining, in the displayed image accordingto the user input, a refocus area including at least two discontinuousdepth intervals includes acquiring input of at least two times ofsingle-point sliding performed on a touchscreen by a user, determiningat least two discontinuous depth intervals corresponding to the at leasttwo times of single-point sliding, and determining the at least twodiscontinuous depth intervals as the refocus area, where each time ofsingle-point sliding corresponds to one depth interval; or acquiring atleast two times of divergent multipoint sliding performed on atouchscreen by a user using multiple fingers, constructing a closedgraphic area using, as a vertex or a side, a position in which eachfinger is located when each time of sliding stops, determining at leasttwo discontinuous depth intervals corresponding to at least two graphicareas constructed by performing the at least two times of divergentmultipoint sliding using the multiple fingers, and determining the atleast two discontinuous depth intervals as the refocus area, where eachclosed graphic area corresponds to one depth interval; or acquiring atrail or a closed geometric graphic, where the trail or the closedgeometric graphic is drawn by a user using multiple fingers to performmultipoint sliding on a touchscreen or using a single finger to performsingle-point sliding on a touchscreen, moving the trail or the closedgeometric graphic to another position of the displayed image,determining at least two discontinuous depth intervals corresponding toan original position and the moved-to position of the trail or theclosed geometric graphic, and determining the at least two discontinuousdepth intervals as the refocus area, where each trail or each closedgeometric graphic corresponds to one depth interval; or acquiring atleast two times of single-point tapping performed on a touchscreen by auser, so as to select at least two points, and determining, as therefocus area according to one or more predefined depth interval values,at least two discontinuous depth intervals containing the points, whereeach of the points corresponds to one depth interval.

In a third possible implementation manner of the first aspect, theacquiring user input, and determining, in the displayed image accordingto the user input, a refocus area including at least two discontinuousdepth intervals includes displaying a corresponding graphic object onthe display device when a user touches and holds a physical button or agraphic button, detecting a posture operation performed on a device bythe user, marking, using the graphic object, a path that the postureoperation passes, using the path, marked using the graphic object, toobtain the refocus area, and when the user touches and holds thephysical button or the graphic button again, repeating the foregoingactions to select a next refocus area; or displaying the graphic objecton the display device, where the graphic object performs a correspondingphysical motion along with the posture operation performed on a deviceby the user, using a current position of the graphic object to obtainthe refocus area when the user triggers a physical button or a graphicbutton, and repeating, by the user, the foregoing actions to select anext refocus area; where the detecting a posture operation performed ona device by the user includes acquiring a translation operationperformed on the device by the user, mapping a translation distance ofthe device to a spatial position of a scenario in the displayed image,and refocusing the scenario in the spatial position; or acquiring atilting operation performed on the device by the user, mapping a tiltangle of the device to a spatial position of a scenario in the displayedimage, and refocusing the scenario in the spatial position.

In a fourth possible implementation manner of the first aspect, theacquiring user input, and determining, in the displayed image accordingto the user input, a refocus area including at least two discontinuousdepth intervals includes displaying a graphic object on the displaydevice, tracing a trail on which a hand of a user moves, moving thegraphic object along the trail that is obtained by means of tracing andon which the hand of the user moves, determining the at least twodiscontinuous depth intervals in an area in the displayed image, wherethe area is covered by the movement trail of the graphic object, anddetermining the at least two discontinuous depth intervals as therefocus area; or monitoring an action that a user pushes a palm,mapping, to a spatial position in the displayed image, a motion path ofthe action of pushing the palm, determining the at least twodiscontinuous depth intervals in the spatial position in the displayedimage, where the spatial position is obtained by means of mapping, anddetermining the at least two discontinuous depth intervals as therefocus area.

With reference to the first aspect to the fourth possible implementationmanner of the first aspect, in a fifth possible implementation manner ofthe first aspect, after the determining, in the displayed imageaccording to the user input, a refocus area including at least twodiscontinuous depth intervals, and before the performing refocusingprocessing on an image within the refocus area to display a refocusedimage on the display device, the method further includes determiningrefocusing information of the refocus area; and correspondingly, theperforming refocusing processing on an image within the refocus area todisplay a refocused image on the display device includes performing,based on the refocusing information, the refocusing processing on theimage within the refocus area, so as to obtain the refocused image bymeans of synthesis, and displaying the refocused image on the displaydevice.

With reference to the fifth possible implementation manner of the firstaspect, in a sixth possible implementation manner of the first aspect,after the acquiring user input, the method further includes generating,according to the user input, a graphic object used for identifying therefocus area selected by the user, and performing displaying the graphicobject, where the graphic object includes a point, a line, a circle, anoval, or a polygon; and correspondingly, the determining refocusinginformation of the refocus area includes, if the graphic object is apoint, using, as the refocusing information according to a predefineddepth interval value, information about a depth interval containing thepoint and/or information about a pixel interval containing the point; orif the graphic object is a line, using, as the refocusing information,depth interval information corresponding to the line and/or pixelinterval information corresponding to the line; or if the graphic objectis a circle, using, as the refocusing information, depth intervalinformation corresponding to an area contained by the circle and/orpixel interval information corresponding to an area contained by thecircle; or if the graphic object is an oval, using, as the refocusinginformation, depth interval information corresponding to an areacontained by the oval and/or pixel interval information corresponding toan area contained by the oval; or if the graphic object is a polygon,using, as the refocusing information, depth interval informationcorresponding to an area contained by the polygon and/or pixel intervalinformation corresponding to an area contained by the polygon.

With reference to the first aspect to the sixth possible implementationmanner of the first aspect, in a seventh possible implementation mannerof the first aspect, after the acquiring user input, the method furtherincludes determining display information according to the user input,where the display information includes a divergence center and/or adisplay order of the refocused image; and correspondingly, thedisplaying the refocused image on the display device includesdisplaying, starting from the divergence center and from inside tooutside or from outside to inside, the refocused images on the displaydevice; or displaying the refocused images on the display devicesequentially according to the display order, or interactively, orsimultaneously.

With reference to the fifth possible implementation manner of the firstaspect, in an eight possible implementation manner of the first aspect,the determining refocusing information of the refocus area includescalculating depth interval information and/or pixel interval informationof a scenery in each refocus area, and using the depth intervalinformation and/or the pixel interval information as the refocusinginformation, where the depth interval information includes at least onedepth plane, and the pixel interval information includes any one orseveral types of the following information: pixel coordinateinformation, intensity information, color information, and focusinginformation.

In a ninth possible implementation manner of the first aspect, thedetermining refocusing information of the refocus area includes matchingthe user input in a user input case set, and determining, in thedisplayed image according to the user input, depth interval informationand/or pixel interval information as the refocusing information, wherethe depth interval information and/or pixel interval informationcorresponds to the user input.

With reference to the sixth or seventh possible implementation manner ofthe first aspect, in a tenth possible implementation manner of the firstaspect, after the determining refocusing information of the refocusarea, the method further includes displaying the corresponding depthinterval information, the corresponding pixel interval information, andcorresponding depth-of-field information on the display device.

With reference to the fifth possible implementation manner of the firstaspect, in an eleventh possible implementation manner of the firstaspect, the performing, based on the refocusing information, therefocusing processing on the image within the refocus area, so as toobtain the refocused image by means of synthesis includes processing,based on the refocusing information, data corresponding to the displayedimage, so as to obtain, by means of synthesis, one image in whichrefocusing is simultaneously performed on multiple depth planes ormultiple images in which refocusing is simultaneously performed onmultiple depth planes; and correspondingly, the displaying the refocusedimage on the display device includes displaying the one image in whichrefocusing is simultaneously performed on the multiple depth planes orthe multiple images in which refocusing is simultaneously performed onthe multiple depth planes.

With reference to the sixth possible implementation manner of the firstaspect, in a twelfth possible implementation manner of the first aspect,the displaying the refocused image on the display device includesdisplaying all the refocused images sequentially according to a presetsequence starting from a refocused image corresponding to the divergencecenter of the refocus area.

With reference to the sixth possible implementation manner of the firstaspect, in a thirteenth possible implementation manner of the firstaspect, the displaying the refocused image on the display deviceincludes displaying the refocused image according to predefinedinformation, where the predefined information includes a predefineddivergence center, a display order, and the displayed graphic object.

According to a second aspect, an embodiment of the present disclosureprovides a multi-depth-interval refocusing apparatus, including adisplay module configured to display an image on a display device; aprocessing module configured to acquire user input, and determine, inthe displayed image according to the user input, a refocus areaincluding at least two discontinuous depth intervals, where each depthinterval in the at least two discontinuous depth intervals isconstituted by at least one depth plane, each depth plane contains atleast one focus pixel, and depths of object points corresponding tofocus pixels contained on a same depth plane are the same, where theprocessing module is further configured to perform refocusing processingon an image within the refocus area to display a refocused image on thedisplay device, where the refocused image has a visually distinguishabledefinition difference relative to an area, except the refocus area, inthe displayed image; and the display module is further configured todisplay the refocused image on the display device.

In a first possible implementation manner of the second aspect, thedisplay module is configured to display, on the display device, an imagefocused on any depth plane; or display, on the display device, an imagefocused within any depth interval.

In a second possible implementation manner of the second aspect, theprocessing module is configured to acquire input of at least two timesof single-point sliding performed on a touchscreen by a user, determineat least two discontinuous depth intervals corresponding to the at leasttwo times of single-point sliding, and determine the at least twodiscontinuous depth intervals as the refocus area, where each time ofsingle-point sliding corresponds to one depth interval; or acquire atleast two times of divergent multipoint sliding performed on atouchscreen by a user using multiple fingers, construct a closed graphicarea using, as a vertex or a side, a position in which each finger islocated when each time of sliding stops, determine at least twodiscontinuous depth intervals corresponding to at least two graphicareas constructed by performing the at least two times of divergentmultipoint sliding using the multiple fingers, and determine the atleast two discontinuous depth intervals as the refocus area, where eachclosed graphic area corresponds to one depth interval; or acquire atrail or a closed geometric graphic, where the trail or the closedgeometric graphic is drawn by a user using multiple fingers to performmultipoint sliding on a touchscreen or using a single finger to performsingle-point sliding on a touchscreen, move the trail or the closedgeometric graphic to another position of the displayed image, determineat least two discontinuous depth intervals corresponding to an originalposition and the moved-to position of the trail or the closed geometricgraphic, and determine the at least two discontinuous depth intervals asthe refocus area, where each trail or each closed geometric graphiccorresponds to one depth interval; or acquire at least two times ofsingle-point tapping performed on a touchscreen by a user, so as toselect at least two points, and determine, as the refocus area accordingto one or more predefined depth interval values, at least twodiscontinuous depth intervals containing the points, where each of thepoints corresponds to one depth interval.

In a third possible implementation manner of the second aspect, theprocessing module includes a posture sensor unit configured to display acorresponding graphic object on the display device when a user touchesand holds a physical button or a graphic button, detect a postureoperation performed on a device by the user, mark, using the graphicobject, a path that the posture operation passes, use the path, markedusing the graphic object, as the refocus area, and when the user touchesand holds the physical button or the graphic button again, repeat theforegoing actions to select a next refocus area; or display the graphicobject on the display device, where the graphic object performs acorresponding physical motion along with the posture operation performedon a device by the user, and use a current position of the graphicobject as the refocus area when the user triggers a physical button or agraphic button, where the user repeats the foregoing actions to select anext refocus area; where the posture sensor unit is configured toacquire a translation operation performed on the device by the user, mapa translation distance of the device to a spatial position of a scenarioin the displayed image, and refocus the scenario in the spatialposition; or acquire a tilting operation performed on the device by theuser, map a tilt angle of the device to a spatial position of a scenarioin the displayed image, and refocus the scenario in the spatialposition.

In a fourth possible implementation manner of the second aspect, theprocessing module includes an action tracking unit configured to displaya graphic object on the display device, trace a trail on which a hand ofa user moves, move the graphic object along the trail that is obtainedby means of tracing and on which the hand of the user moves, determineat least two discontinuous depth intervals in an area in the displayedimage, where the area is covered by the movement trail of the graphicobject, and determine the at least two discontinuous depth intervals asthe refocus area; or monitor an action that a user pushes a palm, map,to a spatial position in the displayed image, a motion path of theaction of pushing the palm, determine at least two discontinuous depthintervals in the spatial position in the displayed image, where thespatial position is obtained by means of mapping, and determine the atleast two discontinuous depth intervals as the refocus area.

With reference to the second aspect to the fourth possibleimplementation manner of the second aspect, in a fifth possibleimplementation manner of the second aspect, the processing module isfurther configured to determine refocusing information of the refocusarea; and perform, based on the refocusing information, the refocusingprocessing on the image within the refocus area, so as to obtain therefocused image by means of synthesis, where the display module isfurther configured to display the refocused image on the display device.

With reference to the fifth possible implementation manner of the secondaspect, in a sixth possible implementation manner of the second aspect,the processing module is further configured to generate, according tothe user input, a graphic object used for identifying the refocus areaselected by the user, and perform displaying the graphic object, wherethe graphic object includes a point, a line, a circle, an oval, or apolygon; and the processing module is configured to, if the graphicobject is a point, use, as the refocusing information according to apredefined depth interval value, information about a depth intervalcontaining the point and/or information about a pixel intervalcontaining the point; or if the graphic object is a line, use, as therefocusing information, depth interval information corresponding to theline and/or pixel interval information corresponding to the line; or ifthe graphic object is a circle, use, as the refocusing information,depth interval information corresponding to an area contained by thecircle and/or pixel interval information corresponding to an areacontained by the circle; or if the graphic object is an oval, use, asthe refocusing information, depth interval information corresponding toan area contained by the oval and/or pixel interval informationcorresponding to an area contained by the oval; or if the graphic objectis a polygon, use, as the refocusing information, depth intervalinformation corresponding to an area contained by the polygon and/orpixel interval information corresponding to an area contained by thepolygon.

With reference to the second aspect to the sixth possible implementationmanner of the second aspect, in a seventh possible implementation mannerof the second aspect, the processing module is further configured todetermine display information according to the user input, where thedisplay information includes a divergence center and/or a display orderof the refocused image; and the display module is configured to display,starting from the divergence center and from inside to outside or fromoutside to inside, the refocused images on the display device; ordisplay the refocused images on the display device sequentiallyaccording to the display order, or interactively, or simultaneously.

With reference to the fourth possible implementation manner of thesecond aspect, in an eighth possible implementation manner of the secondaspect, the processing module further includes a calculation unitconfigured to calculate depth interval information and/or pixel intervalinformation of a scenery in each refocus area, and use the depthinterval information and/or the pixel interval information as therefocusing information, where the depth interval information includes atleast one depth plane, and the pixel interval information includes anyone or several types of the following information: pixel coordinateinformation, intensity information, color information, and focusinginformation.

In a ninth possible implementation manner of the second aspect, theprocessing module is further configured to match the user input in auser input case set, and determine, in the displayed image according tothe user input, depth interval information and/or pixel intervalinformation as the refocusing information, where the depth intervalinformation and/or pixel interval information corresponds to the userinput.

With reference to the fifth or sixth possible implementation manner ofthe second aspect, in a tenth possible implementation manner of thesecond aspect, the display module is further configured to display thecorresponding depth interval information, the corresponding pixelinterval information, and corresponding depth-of-field information onthe display device.

With reference to the fourth possible implementation manner of thesecond aspect, in an eleventh possible implementation manner of thesecond aspect, the processing module is configured to process, based onthe refocusing information, data corresponding to the displayed image,so as to obtain, by means of synthesis, one image in which refocusing issimultaneously performed on multiple depth planes or multiple images inwhich refocusing is simultaneously performed on multiple depth planes;and correspondingly, the display module is configured to display the oneimage in which refocusing is simultaneously performed on the multipledepth planes or the multiple images in which refocusing issimultaneously performed on the multiple depth planes.

With reference to the fourth possible implementation manner of thesecond aspect, in a twelfth possible implementation manner of the secondaspect, the display module is configured to display all the refocusedimages sequentially according to a preset sequence starting from arefocused image corresponding to the divergence center of the refocusarea.

With reference to the fourth possible implementation manner of thesecond aspect, in a thirteenth possible implementation manner of thesecond aspect, the display module is configured to display the refocusedimage according to predefined information, where the predefinedinformation includes a predefined divergence center, a display order,and the displayed graphic object.

According to a third aspect, an embodiment of the present disclosureprovides an electronic device, including at least one processor, amemory controller, a peripheral equipment interface, and an input/outputsystem, where the input/output system is connected to at least a displaydevice and a user input device, and the electronic device furtherincludes any of the foregoing multi-depth-interval refocusingapparatuses.

In a first possible implementation manner of the third aspect, the userinput device is a touchscreen, a touchpad, a posture sensor, and/or anaction tracking module.

In a second possible implementation manner of the third aspect, thedisplay device is configured to display an image and a graphic objectbefore refocusing interaction or in a refocusing process.

According to the multi-depth-interval refocusing method, apparatus andelectronic device that are provided in the embodiments of the presentdisclosure, user input is acquired, and a refocus area including atleast two discontinuous depth intervals is determined in a displayedimage according to the user input; and refocusing processing isperformed on an image within the refocus area to display a refocusedimage on the display device, where the refocused image has a visuallydistinguishable definition difference relative to an area, except therefocus area, in the displayed image, thereby implementingmulti-depth-interval refocusing.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a flowchart of Embodiment 1 of a multi-depth-intervalrefocusing method according to embodiments of the present disclosure;

FIG. 2A is a schematic diagram of Embodiment 1 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2B is a schematic diagram of Embodiment 2 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2C is a schematic diagram of Embodiment 3 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2D is a schematic diagram of Embodiment 4 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2E is a schematic diagram of Embodiment 5 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2F is a schematic diagram of Embodiment 6 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2G is a schematic diagram of Embodiment 7 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2H is a schematic diagram of Embodiment 8 of a user gestureaccording to embodiments of the present disclosure;

FIG. 2I is a schematic diagram of Embodiment 9 of a user gestureaccording to embodiments of the present disclosure;

FIG. 3 is a flowchart of Embodiment 5 of a multi-depth-intervalrefocusing method according to embodiments of the present disclosure;

FIG. 4 is a simplified block diagram of Embodiment 1 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure;

FIG. 5 is a simplified block diagram of Embodiment 2 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure;

FIG. 6 is a simplified block diagram of Embodiment 3 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure; and

FIG. 7 is a simplified block diagram of Embodiment 4 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure.

DESCRIPTION OF EMBODIMENTS

To make the objectives, technical solutions, and advantages of theembodiments of the present disclosure clearer, the following clearlydescribes the technical solutions in the embodiments of the presentdisclosure with reference to the accompanying drawings in theembodiments of the present disclosure. The described embodiments aresome but not all of the embodiments of the present disclosure. All otherembodiments obtained by persons of ordinary skill in the art based onthe embodiments of the present disclosure without creative efforts shallfall within the protection scope of the present disclosure.

A multi-depth-interval refocusing method provided in the embodiments ofthe present disclosure may be applied to the following scenario: for adevice with an imaging module, where a display module of the devicedisplays a scenario image in real time, a user performs interactiveshooting control over the device using the multi-depth-intervalrefocusing method provided in the embodiments of the present disclosure;or for a device, such as a projector, that receives or storesre-focusable data, a user performs, using the multi-depth-intervalrefocusing method provided in the embodiments of the present disclosure,interactive browsing on an image displayed on a display module of thedevice. The image mentioned in the embodiments of the present disclosuremay include an image constituted by original light-field data acquiredby a light-field camera, may be an image that is refocused in any depthafter calculation processing is performed, may be an image in a fulldepth, or may be a virtual image obtained by a computer performingsynthesis.

FIG. 1 is a flowchart of Embodiment 1 of a multi-depth-intervalrefocusing method according to embodiments of the present disclosure.The method in this embodiment is executed by a multi-depth-intervalrefocusing apparatus, where the apparatus is generally implemented byhardware and/or software and may be configured in an electronic device.As shown in FIG. 1, the multi-depth-interval refocusing method providedin this embodiment may include the following steps.

Step 101: Display an image on a display device.

The displayed image may be an image focused on a depth plane, or may bea fully focused image, where the depth refers to a distance between ascenery and an imaging plane of an imaging element in a camera. Itshould be noted that the displayed image may be an image resulted fromprocessing, using a specific algorithm, data collected by a light-fieldcamera. There is a microlens array between a main lens and an imagesensor of the light-field camera, where each micro lens forms oneelement image that is recorded by the image sensor, and multiple elementimages constitute an image array.

The displaying an image on a display device may include displaying, onthe display device, an image focused on any depth plane; or displaying,on the display device, an image focused within any depth interval.

Step 102: Acquire user input, and determine, in the displayed imageaccording to the user input, a refocus area including at least twodiscontinuous depth intervals, where each depth interval in the at leasttwo discontinuous depth intervals is constituted by at least one depthplane, each depth plane contains at least one focus pixel, and depths ofobject points corresponding to focus pixels contained on a same depthplane are the same.

The user input may be an operation of interaction between a user and thedisplayed image, or may be a user-defined input method, for example,inputting a command, and no limitation is imposed thereto in thisembodiment. The foregoing operation of interaction between the user andthe displayed image may be input of single-point tapping, multiple-pointtapping, single-point sliding, or multipoint sliding performed on atouchscreen by the user. The multi-depth-interval refocusing apparatusmay determine, in the displayed image according to the user input, therefocus area including the at least two discontinuous depth intervals.

Step 103: Perform refocusing processing on an image within the refocusarea to display a refocused image on the display device, where therefocused image has a visually distinguishable definition differencerelative to an area, except the refocus area, in the displayed image.

Refocusing information may be depth interval information, or may bepixel interval information, or may include both depth intervalinformation and pixel interval information. The depth intervalinformation contains at least one depth plane, and a depth interval maybe constituted by one or more continuous depth planes; the pixelinterval information includes any one or several types of the followinginformation: pixel coordinate information, intensity information, colorinformation, and focusing information.

After acquiring the input of the single-point tapping, themultiple-point tapping, the single-point sliding, or the multipointsliding performed on the touchscreen by the user, themulti-depth-interval refocusing apparatus may process, according tofocus pixel coordinates of the refocus area, original data correspondingto a focus pixel in the refocus area, so as to determine refocusinginformation of the refocus area, where the refocusing information mayinclude a depth of an object point corresponding to the focus pixel inthe refocus area, a parallax of the focus pixel in the refocus area, apoint spread function for the focus pixel in the refocus area, a flareradius of the focus pixel in the refocus area, or coordinate informationof the refocus area. It should be noted that, because types ofto-be-processed images are different and implementation methods aredifferent, required refocusing information is also different. Therequired refocusing information may be one type of the foregoingrefocusing information, or may be any combination of the foregoingrefocusing information.

Further, the refocused image obtained by means of synthesis may beobtained by performing a refocusing operation on the image, or may beobtained by performing a fusion splicing operation on the image, or maybe obtained by performing both refocusing and fusion splicing operationson the image, and no limitation is imposed thereto in this embodiment.

Step 104: Display the refocused image on the display device.

The displayed refocused image may be an image displaying that all focuspixels within one refocus area are refocused simultaneously; or may bean image displaying that focus pixels within a refocus area arerefocused sequentially from a divergence center to outside, where thedivergence center of the displayed information is a starting point ofthe action; or may be refocused images that contain at least two depthintervals and that are displayed sequentially from near to far or fromfar to near in a sequence of a nearest depth, an intermediate depth, afarthest depth, and the like of the depth intervals.

According to the multi-depth-interval refocusing method provided in thisembodiment, user input is acquired, and a refocus area including atleast two discontinuous depth intervals is determined in a displayedimage according to the user input; refocusing processing is performed onan image within the refocus area to display a refocused image on thedisplay device, where the refocused image has a visually distinguishabledefinition difference relative to an area, except the refocus area, inthe displayed image, thereby implementing multi-depth-intervalrefocusing.

Based on the embodiment shown in FIG. 1, in this embodiment, step 102may include acquiring, as shown in FIG. 2A, input of at least two timesof single-point sliding performed on a touchscreen by a user,determining at least two discontinuous depth intervals corresponding tothe at least two times of single-point sliding, and determining the atleast two discontinuous depth intervals as the refocus area, where eachtime of single-point sliding corresponds to one depth interval; oracquiring at least two times of divergent multipoint sliding performedon a touchscreen by a user using multiple fingers, constructing, asshown in FIG. 2B, FIG. 2C, FIG. 2D, FIG. 2E, FIG. 2F, and FIG. 2G, aclosed graphic area using, as a vertex or a side, a position in whicheach finger is located when each time of sliding stops, determining atleast two discontinuous depth intervals corresponding to at least twographic areas constructed by performing the at least two times ofdivergent multipoint sliding using the multiple fingers, and determiningthe at least two discontinuous depth intervals as the refocus area,where each closed graphic area corresponds to one depth interval; oracquiring a trail or a closed geometric graphic, where the trail or theclosed geometric graphic is drawn by a user using multiple fingers toperform multipoint sliding on a touchscreen or using a single finger toperform single-point sliding on a touchscreen, moving, as shown in FIG.2H, the trail or the closed geometric graphic to another position of thedisplayed image, determining at least two discontinuous depth intervalscorresponding to an original position and the moved-to position of thetrail or the closed geometric graphic, and determining the at least twodiscontinuous depth intervals as the refocus area, where each trail oreach closed geometric graphic corresponds to one depth interval; oracquiring, as shown in FIG. 2I, at least two times of single-pointtapping performed on a touchscreen by a user, so as to select at leasttwo points, and determining, as the refocus area according to one ormore predefined depth interval values, at least two discontinuous depthintervals containing the points, where each of the points corresponds toone depth interval.

In an actual application process, the user uses a single finger toperform, on the touchscreen, multiple times of single-point tappingsequentially or multiple times of single-point sliding sequentially, soas to select the refocus area containing the at least two discontinuousdepth intervals, and a refocus area containing one depth interval isselected each time single-point tapping or single-point sliding isperformed. Refocusing information may be a nearest depth plane and afarthest depth plane in each depth interval and a sequence in which alldepth intervals are selected. When the user performs single-pointtapping or single-point sliding for the first time, refocusing isperformed within a first selected depth interval. When the user performssingle-point tapping or single-point sliding for the second time,refocusing is performed within a second selected depth interval, and thefirst depth interval remains in a refocused state. When the userperforms multiple times of single-point tapping or multiple times ofsingle-point sliding, an image in which refocusing is performed withinat least two depth intervals is always displayed on the display device;or after all tapping or sliding actions performed by the user stop, animage in which refocusing is simultaneously performed within allselected depth intervals may be displayed; or refocusing is performedwithin selected depth intervals sequentially according to a selectionorder, and finally, a refocused image containing at least two depthintervals is formed; or refocusing is performed within selected depthintervals sequentially from near to far or from far to near according toa depth of a depth interval, and finally, a refocused image containingat least two discontinuous depth intervals is formed.

The user simultaneously performs multipoint tapping or multipointsliding on the touchscreen using multiple fingers, so as to select therefocus area containing the at least two discontinuous depth intervals.Each finger selects a refocus area containing one depth interval, andsliding directions of fingers may be the same, or may be different.Multiple refocus areas may be partially or fully overlapped or may benot overlapped. Refocusing information may be a nearest depth plane anda farthest depth plane in each depth interval and a sequence in whichall depth intervals are selected. During displaying, an image in whichrefocusing is simultaneously performed within all selected depthintervals may be displayed; or refocusing is performed within selecteddepth intervals sequentially according to a selection order, andfinally, a refocused image containing at least two depth intervals isformed; or refocusing is performed within selected depth intervalssequentially from near to far or from far to near according to a depthof a depth interval, and finally, a refocused image containing at leasttwo discontinuous depth intervals is formed.

When the user performs multiple times of divergent multipoint slidingusing multiple fingers, one closed geometric graphic area, for example,a circular area or a polygonal area, may be selected using each fingeras a vertex or a side of the graphic each time. The closed geometricgraphic area corresponds to one depth interval. By repeating theforegoing actions, the user may select the refocus area containing theat least two discontinuous depth intervals. Refocusing information maybe a nearest depth plane and a farthest depth plane in each depthinterval, a geometric center, a centroid, and a boundary of each closedgeometric graphic, and a sequence in which all depth intervals areselected. When the user performs divergent multipoint sliding usingmultiple fingers for the first time, refocusing is performed within afirst selected depth interval, and when the user performs divergentmultipoint sliding within multiple fingers for the second time,refocusing is performed within a second selected depth interval, and thefirst depth interval remains in a refocused state. When the userperforms multiple times of divergent multipoint sliding using multiplefingers, an image in which refocusing is performed within at least twodiscontinuous depth intervals is always displayed on a display screen;or after the user performs all divergent multipoint sliding usingmultiple fingers, an image in which refocusing is simultaneouslyperformed within all selected depth intervals may be displayed; orrefocusing is performed within selected depth intervals sequentiallyaccording to a selection order, and finally, a refocused imagecontaining at least two discontinuous depth intervals is formed; orrefocusing is performed within selected depth intervals sequentiallyfrom near to far or from far to near according to a depth of a depthinterval, and finally, a refocused image containing at least twodiscontinuous depth intervals is formed.

When the user performs multipoint sliding or single-point sliding usingmultiple fingers or a single finger, a trail may be drawn, or a closedgeometric graphic may be drawn. Then, the trail or the closed geometricgraphic is moved to another position in the image by performingsingle-point dragging using a single finger. The foregoing action mayimplement a refocusing operation on the trail or in an area included bythe closed geometric graphic, where refocusing information may be anyone of: a depth of a nearest depth plane, a depth of a farthest depthplane, a path of single-point dragging, and a centroid, a geometriccenter, and a boundary of the closed geometric graphic. When the userdrags the trail or the closed geometric graphic, an image may bedisplayed after the dragging is complete, where the image is an image inwhich refocusing is performed simultaneously within all areas covered bya path along which the trail or the closed geometric graphic is dragged;or a refocused image containing at least two depth intervals may bedisplayed sequentially according to a dragging path during the draggingor after the dragging; or a refocused image containing at least twodiscontinuous depth intervals may be displayed sequentially from near tofar or from far to near according to a depth order of the depthintervals after the dragging is complete.

The user selects one point by performing single-point tapping using asingle finger, and then selects, according to a predefined depthinterval value or a user-defined depth interval value, one depthinterval containing the point. The user may select a refocus areaincluding at least two discontinuous depth intervals by repeating theforegoing actions or in a manner of performing simultaneous tappingusing multiple fingers, where the depth interval value may be a depth ofa nearest depth plane of the depth interval and a depth of a farthestdepth plane of the depth interval, and the point selected by the user byperforming single-point tapping using a single finger may be located inany position in the depth interval, where refocusing information may becoordinates of the point selected by the user by performing single-pointtapping.

Further, after the user input on the touchscreen is acquired, depthinterval information corresponding to the user input or pixel intervalinformation corresponding to the user input or both are matched with auser input case set and used as refocusing information. If the userinput and the user input case set are not matched, no correspondingrefocusing operation is performed, and the user is prompted by, forexample, displaying a prompt text or using sound or vibration; or aftera preset time interval expires, user input is monitored again, and theforegoing process is repeated, and no limitation is imposed thereto inthis embodiment.

The user input may be an operation of interaction between the user andthe displayed image, or may be a posture operation performed on thedisplay device by the user, or a user action monitored by the displaydevice, and after the user input is acquired, the acquired user input ismatched with the user input case set, so as to obtain refocusinginformation. The depth interval information contains at least one depthplane, and a depth interval may be constituted by one or more continuousdepth planes; the pixel interval information includes any one or severaltypes of the following information: pixel coordinate information,intensity information, color information, and focusing information.

It should be noted that the refocus area may be all areas correspondingto depth intervals of a closed geometric graphic area, or may be only asubarea, contained by the closed geometric graphic, in an areacorresponding to a depth interval selected in the closed geometricgraphic area.

The touchscreen may be a multi-finger sensitive touchscreen, or may be amulti-finger sensitive touchpad connected to the display device, and nolimitation is imposed thereto in this embodiment.

According to the multi-depth-interval refocusing method provided in thisembodiment, when a multi-depth-interval refocusing apparatus detects acontact between a user finger and a touchscreen, a quantity of contactsand positions of the contacts are determined. Then, whether the userfinger moves is detected. If the user finger does not move, refocusinginformation corresponding to a selected refocus area is calculated. Ifthe user finger moves, a movement speed, a movement direction, amovement acceleration, and a movement path are detected and tracked,whether the movement ends is determined, and if the movement ends,refocusing information corresponding to a combination of the contactsand the movement or corresponding to a series of gestures is calculated,or if the movement does not end, detecting of the movement pathcontinues until the movement ends. Finally, a refocusing operation or animage fusion splicing operation or both are performed on each imageaccording to the calculated refocusing information obtained by means ofcalculation, and an image obtained by means of refocusing is displayedon the display device.

It should be noted that the user may select whether to use therefocusing mode. If the refocusing mode is used, themulti-depth-interval refocusing apparatus may perform a correspondingrefocusing operation on the image according to user input, and if anaction performed by the user does not belong to actions that can beidentified by the multi-depth-interval refocusing apparatus, themulti-depth-interval refocusing apparatus prompts the user in a specificmanner, for example, displaying a prompt text, using voice forprompting, or using vibration for prompting. If the refocusing mode isnot used, an action performed by the user is ignored even if the actionbelongs to actions that can be identified by the multi-depth-intervalrefocusing apparatus, and the multi-depth-interval refocusing apparatusdoes not perform a refocusing operation on the image, without affectingnormal use of another operation.

According to the multi-depth-interval refocusing method provided in thisembodiment, interactive input is performed on a displayed image by auser; a refocus area is determined according to the user input, and thenrefocusing information is determined according to the refocus area; datacorresponding to the displayed image is processed based on therefocusing information, so as to obtain a multi-depth-interval refocusedimage by means of synthesis, thereby implementing multi-depth-intervalrefocusing. In addition, the user may delimit a refocus area in amultipoint input manner, and select and display multiple depth intervalson which refocusing is simultaneously performed.

Based on the embodiment shown in FIG. 1, in this embodiment, step 102may include displaying a corresponding graphic object on the displaydevice when a user touches and holds a physical button or a graphicbutton, detecting a posture operation performed on a device by the user,marking, using the graphic object, a path that the posture operationpasses, using the path, marked using the graphic object, to obtain therefocus area, and when the user touches and holds the physical button orthe graphic button again, repeating the foregoing actions to select anext refocus area; or displaying the graphic object on the displaydevice, where the graphic object performs a corresponding physicalmotion along with the posture operation performed on a device by theuser, using a current position of the graphic object to obtain therefocus area when the user triggers a physical button or a graphicbutton, and repeating, by the user, the foregoing actions to select anext refocus area.

The detecting a posture operation performed on a device by the userincludes acquiring a translation operation performed on the device bythe user, mapping a translation distance of the device to a spatialposition of a scenario in the displayed image, and refocusing thescenario in the spatial position; or acquiring a tilting operationperformed on the device by the user, mapping a tilt angle of the deviceto a spatial position of a scenario in the displayed image, andrefocusing the scenario in the spatial position.

A posture sensor may detect a direction, an azimuth, an acceleration, anangular acceleration, or any combination thereof of a device during anaction of the device, such as rotation, deflection, or an axial motion,so as to reconstruct a currently-complete three dimensional (3D) postureof the device. For example, when the user rotates a device forwards orpulls a device close to the user, the posture sensor senses a currentposture of the device and matches the current posture with a user inputcase set. If the current posture and the user input case set arematched, a refocused image of a scenario at close distance iscorrespondingly displayed. When the user rotates a device backwards orpushes a device away, the posture sensor senses a current posture of thedevice and matches the current posture with a user input case set. Ifthe current posture and the user input case set are matched, a refocusedimage of a remote scenario is correspondingly displayed. If the currentmovement posture of the device and the user input case set are notmatched, no corresponding refocusing operation is performed, and theuser is prompted by, for example, displaying a prompt text or usingsound or vibration; or after a preset time interval expires, a postureof a device is monitored again, and the foregoing process is repeated.

More specifically, when the user translates the device forward, abackground or a foreground in the image is refocused; or when the usertranslates the device backwards, a foreground or a background in theimage is refocused. Alternatively, when the user translates the deviceleftward, an object on a left side of the image or an object on a rightside of the image is refocused; or when the user translates the devicerightward, an object on a right side of the image or an object on a leftside of the image is refocused. A distance for the leftward translationor the rightward translation of the device may be mapped to a spatialposition of a scenario in the image according to a proportionalrelationship. The spatial position corresponds to at least twodiscontinuous depth intervals and includes X-Y coordinates and/or depthinformation.

Alternatively, the user tilts a device forwards, that is, an upper edgeof the device is forward and a lower edge of the device is backward, anda background or a foreground in the image is refocused; or the usertilts a device backwards, that is, an upper edge of the device isbackward and a lower edge of the device is forward, and a foreground ora background in the image is refocused. Alternatively, the user tilts adevice leftwards, that is, a left edge of the device is forward and aright edge of the device is backward, and an object on a left side ofthe image or an object on a right side of the image is refocused; or theuser tilts a device rightwards, that is, a right edge of the device isbackward and a left edge of the device is backward, and an object on aright side of the image or an object on a left side of the image isrefocused. Tilting may contain only rotation, or may contain bothtranslation and rotation; a central axis of the rotation may be avirtual rotation axis passing through a mobile phone, or may be avirtual rotation axis outside a mobile phone. For example, a wrist jointof a user keeps still, a palm is upward, and the palm swings from sideto side. A tilt angle of the device is mapped to a spatial position of ascenario in the image according to a proportional relationship. Thespatial position corresponds to at least two discontinuous depthintervals and includes X-Y coordinates and/or depth information.

Alternatively, when the user touches and holds a physical button or agraphic button, a corresponding graphic object is displayed on thedisplay device, and a position of the graphic object correspondinglychanges with a posture of the device. For example, when the user touchesand holds the button, a circular point is displayed on the displaydevice. When the user manipulates the device to enable the posture ofthe device to change, the circular point simulates a correspondingphysical motion, and marks, just like a paintbrush, a path using agraphic object such as a curve, so as to select a refocus area.Alternatively, a graphic object is displayed on the display device,where the graphic object performs a corresponding physical motion alongwith a posture change of a mobile device. Then, when the user triggersthe physical or graphic button, an image area in a current position ofthe graphic object is selected as the refocus area. A change of theposture, including a translation distance and a rotation angle, of thedevice is mapped to a spatial position of a scenario in the imageaccording to a proportional relationship, and the spatial positioncorresponds to at least two discontinuous depth intervals and includesX-Y coordinates and/or depth information.

If the user wants to form a section of continuous refocus area, a presetbutton supporting the function may be touched and held, and a devicehaving a posture sensor is rotated or moved at the same time, so as toselect the section of continuous refocus area, where the continuousrefocus area contains at least two discontinuous depth intervals.

Further, the posture sensor may include a gyroscope, an accelerometer, amagnetometer, a gravity sensor, and the like. The foregoing gyroscopemeasures an angular velocity during deflection and tilting of thedevice; the foregoing accelerometer can measure a magnitude and adirection of an acceleration of a device; the foregoing magnetometer canmeasure intensity and a direction of a magnetic field; and the foregoinggravity sensor determines a horizontal direction by sensing magnitudesof component forces in gravitational and orthogonal directions of aweight. According to the multi-depth-interval refocusing method providedin this embodiment, a posture sensor detects a motion rate, a motiondirection, an acceleration, an angular acceleration, a gravityacceleration, or any combination thereof, of a device in each direction,so as to acquire a current motion posture of the device, therebydetermining a refocus area that contains at least two discontinuousdepth intervals and that is selected by the user.

It can be learned from the above that, according to themulti-depth-interval refocusing method provided in this embodiment, arefocus area containing at least two discontinuous depth intervals isdetermined by detecting a posture operation performed on a device by auser, and then refocusing information is determined; and datacorresponding to an image is processed, so as to obtain a refocusedimage by means of synthesis and display the refocused image, therebyimplementing multi-depth-interval refocusing.

Based on the embodiment shown in FIG. 1, in this embodiment, step 102may include displaying a graphic object on the display device, tracing atrail on which a hand of a user moves, moving the graphic object alongthe trail that is obtained by means of tracing and on which the hand ofthe user moves, determining the at least two discontinuous depthintervals in an area in the displayed image, where the area is coveredby the movement trail of the graphic object, and determining the atleast two discontinuous depth intervals as the refocus area; ormonitoring an action that a user pushes a palm, mapping, to a spatialposition in the displayed image, a motion path of the action of pushingthe palm, determining the at least two discontinuous depth intervals inthe spatial position in the displayed image, where the spatial positionis obtained by means of mapping, and determining the at least twodiscontinuous depth intervals as the refocus area.

It should be noted that the graphic object is displayed on the displaydevice, the trail on which the hand of the user moves in a specificspatial area is traced, the graphic object is moved along the trail thatis obtained by means of tracing and on which the hand of the user moves,the at least two discontinuous depth intervals are determined in an areain the displayed area, where the area is covered by the movement trailof the graphic object, and the at least two discontinuous depthintervals are determined as the refocus area, where hand movement beyondthe specific spatial area is deemed an invalid movement and does notchange a position of the graphic object; or the action that a userpushes a palm in a specific spatial area is monitored, a motion path ofthe action of pushing the palm in the specific spatial area is mapped toa spatial position in the displayed image, the at least twodiscontinuous depth intervals are determined in the displayed imageobtained by means of mapping, and the at least two discontinuous depthintervals are determined as the refocus area, where an action of pushingthe palm in an area beyond the specific spatial area is deemed aninvalid action, for which no mapping is performed.

An action tracking module may collect and track a current action of theuser and match the collected user action with a user input case set, soas to determine at least one refocus area that is selected. If the useraction and the user input case set are not matched, no correspondingrefocusing operation is performed, and the user is prompted by, forexample, displaying a prompt text or using sound or vibration; or aftera preset time interval expires, a user action is monitored again, andthe foregoing process is repeated.

In a feasible implementation manner, the action tracking module may be acamera, an infrared motion sensing device, or the like. The actiontracking module may execute an operation or an instruction, where theoperation or the instruction is related to collecting and tracking auser action. The user action may be a motion across space performedrelative to the action tracking module by a user using a finger, a palm,an eyeball, or a head.

According to the multi-depth-interval refocusing method provided in thisembodiment, an action tracking module monitors and identifies a useraction; and if the user action can be identified, a correspondingrefocusing operation is performed, or if the user action cannot beidentified, after a preset time interval expires, a user action ismonitored again, and the foregoing process is repeated.

For example, a graphic object is displayed on a display device, a userwaves to a device, the graphic object tracks the waving action of theuser and selects, like a paintbrush, an area that the graphic objectpasses as a refocus area. For example, if the user waves to formmultiple closed circles, multiple closed circles are displayed on thedisplay device and represent multiple selected refocus areas. Foranother example, if the user draws a trail using a hand, the graphicobject tracks the action of the hand of the user and draws, like apaintbrush, a corresponding trail on a display screen, where an areathat the trail passes is a refocus area. A motion path of the hand ofthe user is mapped to a spatial portion, including X-Y coordinatesand/or depth information, of a scenario in an image according to amathematical relationship.

Alternatively, if a user pushes a hand forwards, a foreground isrefocused; if a user pushes a hand backwards, a background is refocused;if a user waves leftwards, an object on a left side is refocused; or ifa user waves rightwards, an object on a right side is refocused. Amotion path of the hand of the user is mapped to a spatial portion,including X-Y coordinates and/or depth information, of a scenario in animage according to a mathematical relationship.

It can be learned from the above that interactive input is performed ona displayed image by a user; a refocus area containing at least twodiscontinuous depth intervals is determined by detecting a user action,and then refocusing information is determined; data corresponding to animage is processed, so as to obtain a refocused image by means ofsynthesis and display the refocused image, thereby implementingmulti-depth-interval refocusing.

FIG. 3 is a flowchart of Embodiment 5 of a multi-depth-intervalrefocusing method according to embodiments of the present disclosure.The method in this embodiment is executed by a multi-depth-intervalrefocusing apparatus, where the apparatus is generally implemented byhardware and/or software and may be configured in an electronic device.As shown in FIG. 3, in the multi-depth-interval refocusing methodprovided in this embodiment, based on the embodiment shown in FIG. 1,the method provided in this embodiment may include the following steps.

Step 201: Display an image on a display device.

Step 202: Acquire user input, and determine, in the displayed imageaccording to the user input, a refocus area including at least twodiscontinuous depth intervals.

In this step, a graphic object used for identifying the refocus areaselected by a user may be generated according to the user input and isdisplayed, where the graphic object includes a point, a line, a circle,an oval, or a polygon.

Step 203: Determine refocusing information of the refocus area.

Corresponding to step 202, if the graphic object is a point, informationabout a depth interval containing the point or information about a pixelinterval containing the point or both are used as the refocusinginformation according to a predefined depth interval value; or if thegraphic object is a line, the depth interval information correspondingto the line or pixel interval information corresponding to the line orboth are used as the refocusing information; or if the graphic object isa circle, the depth interval information corresponding to an areacontained by the circle or pixel interval information corresponding toan area contained by the circle or both are used as the refocusinginformation; or if the graphic object is an oval, the depth intervalinformation corresponding to an area contained by the oval or pixelinterval information corresponding to an area contained by the oval orboth are used as the refocusing information; or if the graphic object isa polygon, the depth interval information corresponding to an areacontained by the polygon or pixel interval information corresponding toan area contained by the polygon or both are used as the refocusinginformation.

In this step, depth interval information and/or pixel intervalinformation of a scenery in each refocus area may also be calculated andused as the refocusing information, where the depth interval informationincludes at least one depth plane, and the pixel interval informationincludes any one or several types of the following information: pixelcoordinate information, intensity information, color information, andfocusing information, and no limitation is imposed thereto in thisembodiment.

Optionally, the corresponding depth interval information, thecorresponding pixel interval information, and correspondingdepth-of-field information may also be displayed on the display device.

Step 204: Determine display information according to the user input,where the display information includes a divergence center and/or adisplay order of a refocused image.

In this embodiment, a sequence of step 203 and step 204 is not limited.In an actual application process, step 204 may be executed first. Thatis, in this embodiment, the display information may be first determinedaccording to the user input, and then the refocusing information isdetermined according to the user input; or the refocusing informationmay be first determined according to the user input, and then thedisplay information is determined according to the user input, and nolimitation is imposed thereto in this embodiment.

The divergence center may be a point in the area selected according tothe user input, or may be a starting point of a trail, or may be apreset range of a point that is selected when a touchscreen is tapped.The divergence center may be optional, or may be predefined. The displayorder may be an order selected according to the user input, or may be adepth order of the depth planes, for example, from near to far or fromfar to near. The display order may be optional, and a predefined displayorder may be used as the display order.

Step 205: Perform, based on the refocusing information, refocusingprocessing on an image within the refocus area, so as to obtain therefocused image by means of synthesis.

In an actual application, data corresponding to the displayed image maybe processed based on the refocusing information, so as to obtain, bymeans of synthesis, one image in which refocusing is simultaneouslyperformed on multiple depth planes or multiple images in whichrefocusing is simultaneously performed on multiple depth planes; andcorrespondingly, the displaying the refocused image on the displaydevice includes displaying the one image in which refocusing issimultaneously performed on the multiple depth planes or the multipleimages in which refocusing is simultaneously performed on the multipledepth planes.

Step 206: Display, starting from the divergence center and from insideto outside or from outside to inside, the refocused images on thedisplay device; or display the refocused images on the display devicesequentially according to the display order, or interactively, orsimultaneously.

When the display device displays the refocused image, all the refocusedimages may be displayed sequentially according to a preset sequencestarting from a refocused image corresponding to the divergence centerof the refocus area; or the refocused image is displayed according topredefined information, where the predefined information includes apredefined divergence center, a display order, and the displayed graphicobject, and no limitation is imposed thereto in this embodiment.

According to the multi-depth-interval refocusing method provided in thisembodiment, after user input is acquired, a divergence center or adisplay order or both are determined, such that a refocused image isdisplayed in a specific manner.

According to the multi-depth-interval refocusing method provided in thisembodiment, interactive input is performed on a displayed image by auser; a refocus area containing at least two discontinuous depthintervals is determined according to user input, and then refocusinginformation and display information are determined; data correspondingto the image is processed, so as to obtain a refocused image by means ofsynthesis and display the refocused image, thereby implementingmulti-depth-interval refocusing.

FIG. 4 is a simplified block diagram of Embodiment 1 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure. As shown in FIG. 4, the multi-depth-intervalrefocusing apparatus provided in this embodiment may include a displaymodule 11 and a processing module 12.

The display module 11 is configured to display an image and a refocusedimage on a display device.

The processing module 12 is configured to acquire user input, anddetermine, in the displayed image according to the user input, a refocusarea including at least two discontinuous depth intervals, where eachdepth interval in the at least two discontinuous depth intervals isconstituted by at least one depth plane, each depth plane contains atleast one focus pixel, and depths of object points corresponding tofocus pixels contained on a same depth plane are the same; or performrefocusing processing on an image within the refocus area to display arefocused image on the display device, where the refocused image has avisually distinguishable definition difference relative to an area,except the refocus area, in the displayed image.

The display module 11 is configured to display an image focused on anydepth plane; or display an image focused within any depth interval. Thedisplayed refocused image may be an image displaying that all focuspixels within a refocus area are simultaneously refocused; or may be animage displaying that focus pixels within a refocus area are refocusedsequentially from a divergence center to outside, where a starting pointof the action is the divergence center of the displayed information; ormay be refocused images that contain at least two depth intervals andthat are displayed sequentially within at least two depth intervals fromnear to far or from far to near in a sequence of a nearest depth, anintermediate depth, a farthest depth, and the like of the depthintervals.

The multi-depth-interval refocusing apparatus in this embodiment may beconfigured to execute technical solutions of the method embodiment shownin FIG. 1, an implementation principle and a technical effect of themulti-depth-interval refocusing apparatus are similar to those of themethod embodiment, and details are not repeatedly described herein.

Based on the foregoing embodiment, in the multi-depth-intervalrefocusing apparatus provided in this embodiment, the processing module12 may be further configured to acquire input of at least two times ofsingle-point sliding performed on a touchscreen by a user, determine atleast two discontinuous depth intervals corresponding to the at leasttwo times of single-point sliding, and determine the at least twodiscontinuous depth intervals as the refocus area, where each time ofsingle-point sliding corresponds to one depth interval; or acquire atleast two times of divergent multipoint sliding performed on atouchscreen by a user using multiple fingers, construct a closed graphicarea using, as a vertex or a side, a position in which each finger islocated when each time of sliding stops, determine at least twodiscontinuous depth intervals corresponding to at least two graphicareas constructed by performing the at least two times of divergentmultipoint sliding using the multiple fingers, and determine the atleast two discontinuous depth intervals as the refocus area, where eachclosed graphic area corresponds to one depth interval; or acquire atrail or a closed geometric graphic, where the trail or the closedgeometric graphic is drawn by a user using multiple fingers to performmultipoint sliding on a touchscreen or using a single finger to performsingle-point sliding on a touchscreen, move the trail or the closedgeometric graphic to another position of the displayed image, determineat least two discontinuous depth intervals corresponding to an originalposition and the moved-to position of the trail or the closed geometricgraphic, and determine the at least two discontinuous depth intervals asthe refocus area, where each trail or each closed geometric graphiccorresponds to one depth interval; or acquire at least two times ofsingle-point tapping performed on a touchscreen by a user, so as toselect at least two points, and determine, as the refocus area accordingto one or more predefined depth interval values, at least twodiscontinuous depth intervals containing the points, where each of thepoints corresponds to one depth interval.

After acquiring the user input on the touchscreen, the processing module12 matches, with a user input case set, depth interval informationcorresponding to the user input and/or pixel interval informationcorresponding to the user input, and uses the depth interval informationand/or the pixel interval information as refocusing information. If theuser input and the user input case set are not matched, no correspondingrefocusing operation is performed, and the user is prompted by, forexample, displaying a prompt text or using sound or vibration; or aftera preset time interval expires, user input is monitored again, and theforegoing process is repeated, and no limitation is imposed thereto inthis embodiment.

It should be noted that the user input acquired by the processing module12 may be an operation of interaction between the user and the displayedimage, or may be a posture operation performed on the display device bythe user, or a user action monitored by the display device, and afterthe user input is acquired, the acquired user input is matched with theuser input case set, so as to obtain refocusing information. The depthinterval information contains at least one depth plane, and a depthinterval may be constituted by one or more continuous depth planes; thepixel interval information includes any one or several types of thefollowing information: pixel coordinate information, intensityinformation, color information, and focusing information.

It should be noted that the refocus area may be all areas correspondingto depth intervals of a closed geometric graphic area, or may be only asubarea, contained by the closed geometric graphic, in an areacorresponding to a depth interval selected in the closed geometricgraphic area.

The multi-depth-interval refocusing apparatus in this embodiment may beconfigured to execute technical solutions of the foregoing methodembodiments. An implementation principle and a technical effect of themulti-depth-interval refocusing apparatus are similar to those of theforegoing method embodiments, and details are not repeatedly describedherein.

FIG. 5 is a simplified block diagram of Embodiment 2 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure. As shown in FIG. 5, based on the foregoingembodiment, in the multi-depth-interval refocusing apparatus provided inthis embodiment, the foregoing processing module 12 may further includea posture sensor unit 21 configured to display a corresponding graphicobject on the display device when a user touches and holds a physicalbutton or a graphic button, detect a posture operation performed on adevice by the user, mark, using the graphic object, a path that theposture operation passes, and use the path, marked using the graphicobject, as the refocus area, and when the user touches and holds thephysical button or the graphic button again, repeat the foregoingactions to select a next refocus area; or display the graphic object onthe display device, where the graphic object performs a correspondingphysical motion along with the posture operation performed on a deviceby the user, and use a current position of the graphic object as therefocus area when the user triggers a physical button or a graphicbutton, where the user repeats the foregoing actions to select a nextrefocus area.

The posture sensor unit 21 is further configured to acquire atranslation operation performed on the device by the user, map atranslation distance of the device to a spatial position of a scenarioin the displayed image, and refocus the scenario in the spatialposition; or acquire a tilting operation performed on the device by theuser, map a tilt angle of the device to a spatial position of a scenarioin the displayed image, and refocus the scenario in the spatialposition.

In an actual application process, the posture sensor unit 21 may detecta direction, an azimuth, an acceleration, an angular acceleration, orany combination thereof of a device during an action of the device, suchas rotation, deflection, or an axial motion, so as to reconstruct acurrently-complete 3D posture of the device. For example, when the userrotates a device forwards or pulls a device close to the user, theposture sensor unit 21 senses a current posture of the device andmatches the current posture with a user input case set. If the currentposture and the user input case set are matched, a refocused image of ascenario at close distance is correspondingly displayed. When the userrotates a device backwards or pushes a device away, the posture sensorunit 21 senses a current posture of the device and matches the currentposture with a user input case set. If the current posture and the userinput case set are matched, a refocused image of a remote scenario iscorrespondingly displayed. If the current movement posture of the deviceand the user input case set are not matched, no corresponding refocusingoperation is performed, and the user is prompted by, for example,displaying a prompt text or using sound or vibration; or after a presettime interval expires, a posture of a device is monitored again, and theforegoing process is repeated.

The multi-depth-interval refocusing apparatus in this embodiment may beconfigured to execute technical solutions of the foregoing methodembodiments. An implementation principle and a technical effect of themulti-depth-interval refocusing apparatus are similar to those of theforegoing method embodiments, and details are not repeatedly describedherein.

FIG. 6 is a simplified block diagram of Embodiment 3 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure. As shown in FIG. 6, based on the foregoingembodiment, in the multi-depth-interval refocusing apparatus provided inthis embodiment, the foregoing processing module 12 may further includean action tracking unit 22 configured to display a graphic object on thedisplay device, trace a trail on which a hand of a user moves, move thegraphic object along the trail that is obtained by means of tracing andon which the hand of the user moves, determine at least twodiscontinuous depth intervals in an area in the displayed image, wherethe area is covered by the movement trail of the graphic object, anddetermine the at least two discontinuous depth intervals as the refocusarea; or monitor an action that a user pushes a palm, map, to a spatialposition in the displayed image, a motion path of the action of pushingthe palm, determine at least two discontinuous depth intervals in thespatial position in the displayed image, where the spatial position isobtained by means of mapping, and determine the at least twodiscontinuous depth intervals as the refocus area.

It should be noted that the graphic object is displayed on the displaydevice, the trail on which the hand of the user moves in a specificspatial area is traced, the graphic object is moved along the trail thatis obtained by means of tracing and on which the hand of the user moves,the at least two discontinuous depth intervals are determined in an areain the displayed image, where the area is covered by the movement trailof the graphic object, and the at least two discontinuous depthintervals are determined as the refocus area, where hand movement beyondthe specific spatial area is deemed an invalid movement and does notchange a position of the graphic object; or the action that a userpushes a palm in a specific spatial area is monitored, a motion path ofthe action of pushing the palm in the specific spatial area is mapped toa spatial position in the displayed image, the at least twodiscontinuous depth intervals are determined in the displayed imageobtained by means of mapping, and the at least two discontinuous depthintervals are determined as the refocus area, where an action of pushingthe palm in an area beyond the specific spatial area is deemed aninvalid action, for which no mapping is performed.

The action tracking unit 22 may collect and track a current action ofthe user and match the collected user action with a user input case set,so as to determine at least one refocus area that is selected. If theuser action and the user input case set are not matched, nocorresponding refocusing operation is performed, and the user isprompted by, for example, displaying a prompt text or using sound orvibration; or after a preset time interval expires, a user action ismonitored again, and the foregoing process is repeated.

In a feasible implementation manner, the action tracking unit 22 may bea camera, an infrared motion sensing device, or the like. The actiontracking unit 22 may execute an operation or an instruction, where theoperation or the instruction is related to collecting and tracking auser action. The user action may be a motion across space performedrelative to the action tracking unit 22 by a user using a finger, apalm, an eyeball, or a head.

The multi-depth-interval refocusing apparatus in this embodiment may beconfigured to execute technical solutions of the foregoing methodembodiments. An implementation principle and a technical effect of themulti-depth-interval refocusing apparatus are similar to those of theforegoing method embodiments, and details are not repeatedly describedherein.

FIG. 7 is a simplified block diagram of Embodiment 4 of amulti-depth-interval refocusing apparatus according to embodiments ofthe present disclosure. As shown in FIG. 7, based on the foregoingembodiment, in the multi-depth-interval refocusing apparatus provided inthis embodiment, the foregoing processing module 12 may furthergenerate, according to the user input, a graphic object used foridentifying the refocus area selected by a user, and perform displayingthe graphic object, where the graphic object includes a point, a line, acircle, an oval, or a polygon.

If the graphic object is a point, the processing module 12 may use, asthe refocusing information according to a predefined depth intervalvalue, information about a depth interval containing the point and/orinformation about a pixel interval containing the point; or if thegraphic object is a line, the processing module 12 may use, as therefocusing information, the depth interval information corresponding tothe line and/or pixel interval information corresponding to the line; orif the graphic object is a circle, the processing module 12 may use, asthe refocusing information, the depth interval information correspondingto an area contained by the circle and/or pixel interval informationcorresponding to an area contained by the circle; or if the graphicobject is an oval, the processing module 12 may use, as the refocusinginformation, the depth interval information corresponding to an areacontained by the oval and/or pixel interval information corresponding toan area contained by the oval; or if the graphic object is a polygon,the processing module 12 may use, as the refocusing information, thedepth interval information corresponding to an area contained by thepolygon and/or pixel interval information corresponding to an areacontained by the polygon.

The processing module 12 may further include a calculation unit 23,where the calculation unit 23 is configured to calculate depth intervalinformation and/or pixel interval information of a scenery in eachrefocus area, and use the depth interval information and/or the pixelinterval information as the refocusing information, where the depthinterval information includes at least one depth plane, and the pixelinterval information includes any one or several types of the followinginformation: pixel coordinate information, intensity information, colorinformation, and focusing information.

The display module 11 may be further configured to display thecorresponding depth interval information, the corresponding pixelinterval information, and corresponding depth-of-field information.

The multi-depth-interval refocusing apparatus in this embodiment may beconfigured to execute technical solutions of the foregoing methodembodiments. An implementation principle and a technical effect of themulti-depth-interval refocusing apparatus are similar to those of theforegoing method embodiments, and details are not repeatedly describedherein.

An electronic device provided in this embodiment may include at leastone processor, a memory controller, a peripheral equipment interface,and an input/output system, where the input/output system is connectedto at least a display device and a user input device; and may furtherinclude the multi-depth-interval refocusing apparatus according to anyone of the foregoing embodiments.

The user input device may be a touchscreen, a touchpad, a posturesensor, and/or an action tracking module; the foregoing display devicemay be configured to display an image and a graphic object beforerefocusing interaction or in a refocusing process.

The electronic device provided in this embodiment may be configured toexecute the technical solutions of any embodiment. An implementationprinciple and a technical effect of the electronic device are similar tothose of any embodiment, and details are not repeatedly describedherein.

Persons of ordinary skill in the art may understand that all or some ofthe steps of the method embodiments may be implemented by a programinstructing relevant hardware. The program may be stored in acomputer-readable storage medium. When the program runs, the steps ofthe method embodiments are performed. The foregoing storage mediumincludes any medium that can store program code, such as a read-onlymemory (ROM), a random access memory (RAM), a magnetic disc, or anoptical disc.

Finally, it should be noted that the foregoing embodiments are merelyintended for describing the technical solutions of the presentdisclosure, but not for limiting the present disclosure. Although thepresent disclosure is described in detail with reference to theforegoing embodiments, persons of ordinary skill in the art shouldunderstand that they may still make modifications to the technicalsolutions described in the foregoing embodiments or make equivalentreplacements to some or all technical features thereof, withoutdeparting from the scope of the technical solutions of the embodimentsof the present disclosure.

What is claimed is:
 1. A multi-depth-interval refocusing method,comprising: displaying an image on a display device; acquiring userinput, and determining, in the displayed image according to the userinput, a refocus area comprising at least two discontinuous depthintervals, each depth interval in the at least two discontinuous depthintervals being constituted by at least one depth plane, each depthplane containing at least one focus pixel, depths of object pointscorresponding to focus pixels contained on a same depth plane being thesame, acquiring the user input, and determining, in the displayed imageaccording to the user input, the refocus area comprising at least twodiscontinuous depth intervals comprising at least one of: acquiring atleast two times of divergent multipoint sliding performed on atouchscreen by a user using multiple fingers, constructing a closedgraphic area using, as a vertex or a side, a position in which eachfinger is located when each time of sliding stops, determining at leasttwo discontinuous depth intervals corresponding to at least two graphicareas constructed by performing the at least two times of divergentmultipoint sliding using the multiple fingers, and determining the atleast two discontinuous depth intervals as the refocus area, each closedgraphic area corresponding to one depth interval; and acquiring a trailor a closed geometric graphic, the trail or the closed geometric graphicbeing drawn by the user using multiple fingers to perform multipointsliding on a touchscreen or using a single finger to performsingle-point sliding on a touchscreen, moving the trail or the closedgeometric graphic to another position of the displayed image,determining at least two discontinuous depth intervals corresponding toan original position and a moved-to position of the trail or the closedgeometric graphic, and determining the at least two discontinuous depthintervals as the refocus area, each trail or each closed geometricgraphic corresponding to one depth interval; matching the user input ina user input case set; notifying the user in response to the user inputnot matching the user input case set; determining, in the displayedimage according to the user input, depth interval information or pixelinterval information as refocusing information in response to the userinput matching the user input case set, the depth interval informationor pixel interval information corresponding to the user input;performing, based on the refocusing information, refocusing processingon an image within the refocus area in order to obtain a refocused imageby means of synthesis, the refocused image having a visuallydistinguishable definition difference relative to an area, except therefocus area, in the displayed image; and displaying the refocused imageon the display device.
 2. The method according to claim 1, whereindisplaying the image on the display device comprises displaying, on thedisplay device, at least one of: an image focused on any depth plane;and an image focused within any depth interval.
 3. The method accordingto claim 1, wherein acquiring user input, and determining, in thedisplayed image according to the user input, the refocus area comprisingat least two discontinuous depth intervals further comprises at leastone of: displaying a corresponding graphic object on the display devicewhen the user touches and holds a physical button or a graphic button,detecting a posture operation performed on a device by the user,marking, using the graphic object, a path that the posture operationpasses, using the path, marked using the graphic object, to obtain therefocus area, and when the user touches and holds the physical button orthe graphic button again, repeating the foregoing actions to select anext refocus area; and displaying a graphic object on the displaydevice, the graphic object performing a corresponding physical motionalong with a posture operation performed on a device by the user, usinga current position of the graphic object to obtain the refocus area whenthe user triggers a physical button or a graphic button, and repeating,by the user, the foregoing actions to select a next refocus area,detecting the posture operation performed on the device by the usercomprising at least one of: acquiring a translation operation performedon the device by the user, mapping a translation distance of the deviceto a spatial position of a scenario in the displayed image, andrefocusing the scenario in the spatial position; and acquiring a tiltingoperation performed on the device by the user, mapping a tilt angle ofthe device to a spatial position of a scenario in the displayed image,and refocusing the scenario in the spatial position.
 4. The methodaccording to claim 1, wherein acquiring user input, and determining, inthe displayed image according to the user input, the refocus areacomprising at least two discontinuous depth intervals further comprisesat least one of: displaying a graphic object on the display device,tracing a trail on which a hand of the user moves, moving the graphicobject along the trail that is obtained by means of tracing and on whichthe hand of the user moves, determining the at least two discontinuousdepth intervals in an area in the displayed image, the area beingcovered by the trail of the graphic object, and determining the at leasttwo discontinuous depth intervals as the refocus area; and monitoring anaction that the user pushes a palm, mapping, to a spatial position inthe displayed image, a motion path of the action of pushing the palm,determining the at least two discontinuous depth intervals in thespatial position in the displayed image, the spatial position beingobtained by means of mapping, and determining the at least twodiscontinuous depth intervals as the refocus area.
 5. The methodaccording to claim 1, wherein after acquiring the user input, the methodfurther comprises generating, according to the user input, a graphicobject used for identifying the refocus area selected by the user, andperforming displaying the graphic object, the graphic object comprisinga point, a line, a circle, an oval, or a polygon, and, correspondingly,determining refocusing information of the refocus area comprising: whenthe graphic object is a point, using, as the refocusing informationaccording to a predefined depth interval value, information about adepth interval containing the point or information about a pixelinterval containing the point; when the graphic object is a line, using,as the refocusing information, depth interval information correspondingto the line or pixel interval information corresponding to the line;when the graphic object is a circle, using, as the refocusinginformation, depth interval information corresponding to an areacontained by the circle or pixel interval information corresponding toan area contained by the circle; when the graphic object is an oval,using, as the refocusing information, depth interval informationcorresponding to an area contained by the oval or pixel intervalinformation corresponding to an area contained by the oval; and when thegraphic object is a polygon, using, as the refocusing information, depthinterval information corresponding to an area contained by the polygonor pixel interval information corresponding to an area contained by thepolygon.
 6. The method according to claim 5, wherein after determiningrefocusing information of the refocus area, the method further comprisesdisplaying corresponding depth interval information, corresponding pixelinterval information, and corresponding depth-of-field information onthe display device.
 7. The method according to claim 5, whereindisplaying the refocused image on the display device comprisesdisplaying all refocused images sequentially according to a presetsequence starting from a refocused image corresponding to a divergencecenter of the refocus area.
 8. The method according to claim 5, whereindisplaying the refocused image on the display device comprisesdisplaying the refocused image according to predefined information, thepredefined information comprising a predefined divergence center, adisplay order, and the displayed graphic object.
 9. The method accordingto claim 1, wherein after acquiring the user input, the method furthercomprises determining display information according to the user input,the display information comprising a divergence center or a displayorder of the refocused image, and, correspondingly, displaying therefocused image on the display device comprising displaying, startingfrom the divergence center and from inside to outside or from outside toinside, refocused images on the display device, or displaying refocusedimages on the display device sequentially according to the displayorder, or interactively, or simultaneously.
 10. The method according toclaim 1, wherein determining refocusing information of the refocus areacomprises calculating depth interval information or pixel intervalinformation of a scenery in each refocus area, and using the depthinterval information or the pixel interval information as the refocusinginformation, the depth interval information comprising at least onedepth plane, and the pixel interval information comprising at least oneof pixel coordinate information, intensity information, colorinformation, and focusing information, corresponding depth-of-fieldinformation on the display device.
 11. The method according to claim 1,wherein performing, based on the refocusing information, the refocusingprocessing on the image within the refocus area, so as to obtain therefocused image by means of synthesis comprises processing, based on therefocusing information, data corresponding to the displayed image, so asto obtain, by means of synthesis, one image in which refocusing issimultaneously performed on multiple depth planes or multiple images inwhich refocusing is simultaneously performed on multiple depth planes,and, correspondingly, displaying the refocused image on the displaydevice comprising displaying the one image in which refocusing issimultaneously performed on the multiple depth planes or the multipleimages in which refocusing is simultaneously performed on the multipledepth planes.
 12. The method according to claim 1, wherein notifying theuser in response to the user input not matching the user input case setcomprises notifying the user using sound, vibration, or displaying aprompt text on the display.
 13. An electronic device, comprising: atleast one processor; a memory controller; a peripheral equipmentinterface; and an input/output system, the input/output system beingconnected to at least a display device and a user input device, theelectronic device further comprising a multi-depth-interval refocusingapparatus, and the multi-depth-interval refocusing apparatus comprising:a display configured to display an image on a display device; and aprocessor configured to: acquire user input, and determine, in thedisplayed image according to the user input, a refocus area comprisingat least two discontinuous depth intervals, each depth interval in theat least two discontinuous depth intervals being constituted by at leastone depth plane, each depth plane containing at least one focus pixel,depths of object points corresponding to focus pixels contained on asame depth plane being the same, acquiring the user input, anddetermining, in the displayed image according to the user input, therefocus area comprising at least two discontinuous depth intervalscomprising at least one of: acquiring at least two times of divergentmultipoint sliding performed on a touchscreen by a user using multiplefingers, constructing a closed graphic area using, as a vertex or aside, a position in which each finger is located when each time ofsliding stops, determining at least two discontinuous depth intervalscorresponding to at least two graphic areas constructed by performingthe at least two times of divergent multipoint sliding using themultiple fingers, and determining the at least two discontinuous depthintervals as the refocus area, each closed graphic area corresponding toone depth interval; and acquiring a trail or a closed geometric graphic,the trail or the closed geometric graphic being drawn by the user usingmultiple fingers to perform multipoint sliding on a touchscreen or usinga single finger to perform single-point sliding on a touchscreen, movingthe trail or the closed geometric graphic to another position of thedisplayed image, determining at least two discontinuous depth intervalscorresponding to an original position and a moved-to position of thetrail or the closed geometric graphic, and determining the at least twodiscontinuous depth intervals as the refocus area, each trail or eachclosed geometric graphic corresponding to one depth interval; match theuser input in a user input case set; notify the user in response to theuser input not matching the user input case set; determine, in thedisplayed image according to the user input, depth interval informationor pixel interval information as refocusing information in response tothe user input matching the user input case set, the depth intervalinformation or pixel interval information corresponding to the userinput; and perform, based on the refocusing information, refocusingprocessing on an image within the refocus area in order to obtain arefocused image by means of synthesis, the refocused image having avisually distinguishable definition difference relative to an area,except the refocus area, in the displayed image, and the display beingfurther configured to display the refocused image on the display device.14. The electronic device according to claim 13, wherein the user inputdevice is a touchscreen, a touchpad, a posture sensor, or an actiontracking module.
 15. The electronic device according to claim 14,wherein the display device is configured to display an image and agraphic object before refocusing interaction or in a refocusing process.